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Abstract 

We generalize the strategy we recently introduced to prove the exis- 
tence of the thermodynamic limit for the Sherrington-Kirkpatrick and 
p-spin models, to a wider class of mean field spin glass systems, includ- 
ing models with multi-component and non-Ising type spins, mean field 
spin glasses with an additional Curie- Weiss interaction, and systems 
consisting of several replicas of the spin glass model, where replicas 
are coupled with terms depending on the mutual overlaps. 
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1 Introduction 



In a recent paper we introduced a simple interpolation method, which 
allows to prove the existence of the thermodynamic limit for the quenched 
average of the free energy and ground state energy per site, for a wide class 
of mean field spin glass models ||. This class includes, for instance, the 
well known Sherrington-Kirkpatrick (SK) model |3|, |J and Derrida's p-spin 
model H H 0], for even p. Moreover, we proved almost sure convergence, 
with respect to the quenched disorder, without taking the average. Subse- 
quently, this strategy has been developed in |8j to include, among the others, 
the REM || and GREM |J, and in [TD|, where finite connectivity models 
are considered. In the present paper, we generalize the strategy of [p]] in a 
different direction. The class of models for which we provide a proof of the 
existence of the thermodynamic limit embraces, for instance, models where 
the spin degrees of freedom <7j have several components, which are not neces- 
sarily two-valued Ising variables. In the same way, we show how to treat the 
case where a Curie- Weiss interaction term is added to the mean field spin 
glass Hamiltonian. Finally, the same results hold for a system composed of 
several replicas (i.e., identical copies with the same disorder realization) of 
the mean field spin glass model, where replicas are coupled together by an 
interaction term, which depends on their mutual overlaps. In all of these 
cases, when the method of fl]] is naively applied, there appear terms which 
spoil the simple subadditivity argument which works for the SK and p-spin 
models. The main purpose of this paper is to show that the effect of these 
potentially dangerous terms can be eliminated, by suitably decomposing the 
configuration space. This idea was introduced by Michel Talagrand in Jll 



and developed in a series of important applications. Among these, Talagrand 
proposed a very interesting generalization of the broken replica bounds |12] 
to the case of systems made of two coupled replicas. 

The organization of the paper is as follows. In Section 2, we introduce 
some basic definitions concerning mean field spin glass models. In Section 3, 
we state the main results of the paper, and we give some physically mean- 
ingful examples of models to which they can be applied. Section 4 contains 
the proof of the results. Finally, Section 5 is dedicated to conclusions. 



2 Basic definitions 

In this Section, we recall some basic definitions concerning mean field spin 
glasses, without making reference to any specific model. 

The generic configuration a of the system is defined by N spin degrees 
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of freedom a±, a?, We suppose each <t; to belong to a set <Sg M. n , n e N, 

equipped with an a priori measure v. For instance, the case S ={— 1,+1} 
and v = l/2(5_i + 8+1) corresponds to the usual Ising two-valued variables. 
The Hamiltonian of the model, H^(cr, J), depends on the spin configuration, 
on the system size N and on some quenched disorder, which we denote as 
J. Of course, the Hamiltonian can also depend on some additional external 
fields, e.g., on the magnetic field h. The mean field character of the model 
consists in the condition that, if two configurations a and a' are connected 
by a permutation of the site indices, the random variables H^(a, J) and 
H N (a', J) have the same distribution. 

For a given inverse temperature (3, we introduce the disorder dependent 
partition function Zn(P, J), the quenched average of the free energy per site 
Jn{P), and the Boltzmann-Gibbs state uj, according to the definitions 

Z N ((3,J)= [ dv(a 1 )...dv(a N )eM-PH N (a,J)) : (1) 
Js N 

-(3f N ((3)=N- 1 E\ogZ N (f3,J), (2) 

ujj(A) = Z N ((3, J)~ l [ di/((Ti) . . . du(a N )A(a) exp(-PH N (a, J)), (3) 
Js N 

where A is a generic function of the cr's. 

Let us now introduce the important concept of replicas. Consider a 
generic number n of independent copies of the system, characterized by 
the spin variables af\ af\ . . ., distributed according to the product of 
Boltzmann-Gibbs states 

O - , > (1) . > (2) < 

\lj — Uj Uj ...Uj , 

where each 00^ acts on the corresponding set of oj^'s, and all replicas are 
subject to the same sample J of the quenched disorder. For a generic smooth 
function F of the configuration of s replicas, we define the (.) averages as 

(F(a^\a^,...)) = En J (F(a^,a^,...)), 

where the Boltzmann-Gibbs averages flj acts on the replicated a variables, 
and E is the average with respect to the disorder J. 

3 The existence of the thermodynamic limit 

The main object of interest in the theory is the quenched free energy /at(/3). 
First of all, one would like to prove that it admits a well defined limit, for 
iV — > 00, independently from the explicit calculation of the limit itself. 
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We restrict our analysis to the case of Gaussian models, i.e., models for 
which the Hn(<j, J) are (correlated) Gaussian random variables. Of course, 
these random variables are fully characterized by their mean values 

b N (a) = EH N (a, J) 

and covariance matrix 

c N (a, a') = E(H N (a, J)H N (a', J)) - E(H N (a, J))E(H N (a', J)). 

In order to prove the existence of the thermodynamic limit, we suppose that 
the following conditions are satisfied. First of all, we require that 

^ = ,(mSi ) (a),...,mS v fc) (a)) + 0(iV- 1 ). (4) 

Here, k e N, g is a smooth function of class C 1 and the m^(a) are bounded 
functions, with Nm^j additive in the system size. In other words, 

\m { §(a)\<M Vz,iV,a (5) 

and 

Nm$(a) = Nm&io®) + N 2 m%(a^), (6) 
if iV = Ni + N 2 and if the configuration a can be decomposed as 

° — \°\ i ■ ■ ■ i " N\ ' 1 ) " " " ) A^2 / ' 

As for the covariance matrix, we require that 

Cj ^f 1 = mSH*, O,..., Q%\*, a')) + 0(N-% (7) 

where / is a convex function with continuous derivatives. The variables Q$ 
must satisfy properties analogous to (j5|)-(|§), i.e., 

\Q®(<r,a)\<M Vi,N,a (8) 

and 

NQ%(a,a') = (a« a™) + N 2 Q% , a'^). (9) 

It is interesting to notice that the models considered in [l|] have the addi- 
tional properties that cjy(a,a) does not depend on the configuration a, and 
that g is a linear function. 

Now, we can state our result: 
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Theorem 1. If conditions ([|) to (|J) are satisfied, then the thermodynamic 
limit of the quenched free energy exists: 

lim --L E \nZ N ((3) = f((3). (10) 

N^oo iV jj 

Moreover, the disorder dependent free energy converges almost surely, with 
respect to the disorder realization: 

lim — ——In Z N (/3) = f(/3) J — almost surely, (11) 

TV^oo Njj 

and its disorder fluctuations can be estimated as 
P 



' \nZ N (P)-f N (P) 



N(3 



Nu 2 

>u) <2exp(-— ), (12) 



where 



L = max 1/(37!, . . .,x k )\, (13) 

\xi\<M Vi 

and M is the same constant as in 

Remark As explained in from Eqs. (10)-(12) follows also the con- 
vergence, both under quenched average and J-almost surely, of the ground 
state energy per site. 

Before we turn to the proof of the Theorem, we give a few examples of 
physically meaningful systems to which it applies. 

1. The SK model with non-Ising type spins, defined as 

1 N 
H N (a, J) = — -= JiiO&i ~ h Yl Gi - ( 14 ) 

^ l<i<j<N i=l 

Here, and in the following examples, the couplings J^- are independent iden- 
tically distributed Gaussian random variables, with mean zero and unit vari- 
ance, while h is the magnetic field. As for the spin degrees of freedom, we 
suppose that o~i G S = [—a, a], while the measure v on S, which appears in 
the definition of the partition function, is arbitrary. In this case, 

b N (o) h >-> 

—— = -hm N {o) = --^a l 

i=i 

and conditions @) to @ are clearly satisfied, since \m^{a)\ < a and the total 
magnetization £\ <jj is linear in the system size. Of course, the function g in 
flU) is just g(x) = —hx. As regards the covariance matrix, one finds easily 

£2^) = & + 0(JV -.), 



5 



q<rtr ' = at S <t<<7 *' l g,TCT ' I - fl2 



where 

AT 

7 rr.rr' In 1 / 1 < r 2 

i=l 

is the overlap of the two configurations. Since Nq aa i is additive and f(x) = 
x 2 /2 is convex, conditions (0) to (|Sp are also satisfied. 

2. The SK model with an additional Curie- Weiss interaction, defined as 

1 Jo N N 

H N (a,J) = -= J U (T i< r 3--tf22 (T i (T 3- h 22 a ii 

v ^ l<i<j<N i,j=l i=l 

where Jo is a non random constant and, again, <Ji G [—a, a]. This model 
can be obtained from the previous one, if one supposes that the Gaussian 
variables in (|I4"D have mean value 2J /VN. This case can be dealt with 
in analogy with the previous one, with the only difference that 

= -j omjV (cr) -hm N {a), 

so that g{x) = —hx — J x 2 . 

3. The multi- replica SK model, with coupled replicas. In this case, the 
Hamiltonian depends on the configurations , . . . , <j( n ' of the n replicas, 
which interact through a term depending on the mutual overlaps: 



N 

where g is a smooth C l function of all the overlaps. The check of properties 
to @ is trivial, and is left to the reader. 

4. The SK model with Heisenberg type interaction, defined by the Hamil- 
tonian 

1 N - 

H N (a, J) = y= Y J ij°i *i> ( 15 ) 

^ l<i<j<N i=l 

where has n bounded components , . . . , u\ , and aw denotes scalar 
product in R™. In this case, 

cat (a, cr') 



where 



N 2 

o,5=l 



I N 

ab _ J_ (a) /(6) 



»=i 

It is instructive to verify explicitly that, for these models, the method 
introduced in H does not work, and requires an extension. 
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4 Proof of Theorem 1 



We start with the proof of (0). Results of this kind were firstly obtained in 
13| in the general context of the norms of Gaussian sample functions, and 



later developed in fI3 |, and f[5 |. The book by Talagrand [[Ll|] demonstrates 
at length the usefulness of this idea in the applications to mean field spin 
glass theory. For later convenience, we give a selfcontained proof of the more 
general inequality 



P 

where 



> u ) < 2 exp 



Nu 2 
1>77 



(17) 



du(ai) . . . du(a N ) ex.-p(—PH N (a, J)) 



is a modified disorder-dependent partition function, with the sum over con- 
figurations restricted to an arbitrary nonrandom set in the configuration 
space S N . 

The restriction to a subset of the space of configurations has been ex- 



ploited also in |Tl[ in the case of the p-spin models. 
We rewrite the Gaussian variables H^(a, J) as 

H N (a,J)=^ N (a) + b N (a), (19) 

where, of course, £at(o") is a centered Gaussian random variable, and 

E(t N (<j)t N (a')) = c N (a,a'). 

Given s G M., we define 

<p N (t) = In ExGjsiit') = In Eh. exp {s(3~ l E 2 In Z$(t)) , (20) 

where the interpolating parameter t varies between and 1, and Z^(t) is the 
auxiliary partition function 

Z$(t) = Z^t,J u J 2 ,P) (21) 
= f dv{a) exp(-/5 v / td(^) - pVT^i&C) ~ Ph N {a)). 

JA N 

Here, £jf(cr) and £jv(cr) are two independent copies of the random variable 
£zv(cr), with the same distribution, and E 1 ,E 2 denote average with respect 
to and £ 2 , respectively. For simplicity of notation, we set 



du(a) = dv(ai) . . . dv(o- N ) 
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the a priori measure on S N , and 



the modified Boltzmann weight. 
It is very simple to check that 



ip N (l) - ip N {0) = ln£exp s/T 1 (\nZ^(P) - ElnZ£{{3)) . (22) 
As for the t derivative of (f^it), an application of the formula 

E Xi F({x}) = EixiX^Ed^FHx}) (23) 
5 

which holds for any family of Gaussian random variables {x{\ and any smooth 
function F, gives 



2E 1 G N (t) 

Thanks to the bound one has 

s 2 , Ns 2 

\<PN(t)\ < —max\c N {a,a')\ 

L c,tr 



Ei{G N {t) / du(a)du(a')c N (a,a')E 2 pN(t,cr)E2PN(t,<j') 

AjvxAjv 



max\ f(Q N (a, a'))\ 



Ns 2 L 



2 0",cr' 

Therefore, using Eq. ( |2"2"D and the obvious inequality 
one finds 



(24) 



£exp JV|s 



1 



AT/5 



ln^(/3)-— Eln^(/3) 



iV/3 



< 2exp 



s 2 NL 



(25) 



By Tchebyshev's inequality, 



N(3 



lnZ£(P)-—E\nZ£(/3) 



>u \ < 2exp -N\s\u 



s 2 NL 



(26) 

and, choosing \s\ —u/L, one finally obtains the estimate (|17|). □ 

Now, we can prove the main statements of Theorem 1, concerning the 
existence of the thermodynamic limit. For simplicity, we assume that 



N- L b N (a)=g(m N (a))+0(N- L ), 
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and 

N~ l c N {a, a') = f(Q N (a, a')) + O^ 1 ), 

corresponding to the case k = 1 in Eqs. (|), (0), and that L = 1 in flTBp. 
The general case can be obtained as a simple extension. 

First of all, we prove the existence of the limit along sequences of the 
type {N K } = {N Q n K }, with n, N G N. As in 0, the idea is to find a 
suitable interpolation between the original system, of size Nk, and a system 
composed of n non interacting subsystems, of size Nk-i each. However, in 
the present case, it is also necessary to divide the configuration space into 
sets, such that mjv(c) and Qn(o~, &) ar e approximately constant within each 
set. The idea of restricting to the set of configurations with given overlap was 
introduced by Michel Talagrand [IT], and exploited in a series of important 
applications. For any < e < 1, we can write 



ZnM = E Z Nk^) = E / ^ expHHW*, J)), (27) 

ij=0 i,j=0 ( 



where 

Cii = e S** : < Q^^a)^ (i+l)e,je < m^), < (j + l)e} (28) 

and [x] denotes the integer part of x. Since N K = nN K _i, we can divide the 
system into n subsystems of N K _i spins each, and we denote the configura- 
tion of the £-th subsystem as a^ e \ I = 1, 2, . . . , n. Of course, the following 
inequality holds 

45 (/?) > Z^(f3) = [ du(a) eM-(3H NK (^ J)), (29) 

J dj 

where 

Cu D Ca = {a G S N * : %e < Q Nk _ x (<t® , a®) < (i + l)e, (30) 

je<m NK ^(a^) < (j + l)s, W}. 

Now, we introduce an interpolating parameter < t < 1, and the auxiliary 
partition function 



-(i-^Ew-!^' 1 
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where the £jv(cr) are n independent copies of the random variable £/v(cr). 
Clearly, for the boundary values of the parameter t one has 

- -J—ElnZ^^m = - 1 n E\nZ% f) (B) (31) 
N K /3 NkK ' Nx-tf "k-iW> V ! 

and 



-£lnZ™(l,/3) = —E\nZ^\f3) > — E\n ZX?'((3). (32) 

N K p n k \ ^) n k \^) - N k WJ V ) 

As regards the t derivative, we apply the integration by parts formula ( |2"3"| ) 
and, recalling that the random variables £, e N {cr) are statistically independent 
for different £, we find after some long but straightforward computations, 

--—ElnZ^it^) = 
dtN K p n k \>vj 

-§ (f -lpJ(QN K -M {e \^))\ (33) 

+f (f(QN K (<?,°')) -lpj(QN K ^ {e \°' {e) ))\ (34) 



(35) 

where the averages are, of course, restricted to configurations belonging to 
Cy. Since Qtv x is a convex combination of the Qn k _± and / is a convex 
function, the term ( |34"|) is not positive. On the other hand, since / is a 
function of class C 1 , and Qn K -i 

and are constrained to belong to 
the interval [ie, (i + l)e) for each £, the term (|33|) is of order e. The same 
holds for the term fl3"5|). This implies that, for large enough, 

" ' EhyZ$(t,P)<Ce, (36) 



for some positive constant C independent of N. Recalling Eqs. (|5T|) , 
this means that 



- — £ In Zjg (/?) + — -E In ^ 09) < Ce. (37) 

Now, we want to turn this inequality, which involves disorder averages, into 
an inequality valid J— almost everywhere. To this purpose, we choose e = 
NJ^ 4 and we observe that, thanks to the estimate (|T7|), 



P ( -^ ln ^) ^ ~J^ ElnZ ^ + C£ ) ^ 2ex P ("^^ )(38) 
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and 



Therefore, with probability P > 1 — 4V exp ^— v/ ^ C ~j , one has 



Since the probability of the complementary event is summable in K, it follows 
from Borel-Cantelli lemma [117) that inequality (|40| ) holds J-almost surely, for 
if large enough. As a consequence, one obtains 

[<*] [< 4 ] 
Z* K (/3) = £ ^(/3) > e"^< /4 £ (41,^))" (41) 

ij=0 ij=0 

Here, we have used the property 



Ar (n-l)/2 Nk- 
i,j=0 I K 



k / k \ ' 

i=l \i=l / 



(42) 



which holds if Xj > 0, thanks to the convexity of the function x n . By taking 
the logarithm and dropping terms of lower order in Nk, one has 

' ■hxZ NK (J3)<-—^—\iiZ NK _M + 3CNJ c 1/4 J -a.s., (43) 



N K P Nk _ i( 3 



for K large enough. Notice that, with respect to (|37j), the above inequality 
involves the original free energy, where the sum over over configuration has 
no restrictions. From (|43|), it follows that the thermodynamic limit exists, 
J-almost surely, the term N K 1 ^ 4 being inessential. On the other hand, the 
exponential estimate (|12|) , together with Borel-Cantelli Lemma, implies that 
the limit has a non random value /(/?), for almost every disorder realization 
J. 

Once the almost sure convergence is proved, the convergence of the quenched 
average can be obtained easily, provided that the probability that l/N\iaZ N 
assumes large values is sufficiently small. For instance, one has the following 
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criterion (T^|: given random variables Xk and X, if Xk — > X almost surely 
for K — > oo, and if 

lim supi? (\X K \ X{{\X K \ > A})) = 0, (44) 

A^oo k 

where X{A) denotes the characteristic function of the set A, then 

EXx — ► EX. 

In the present case, Xk = — (1/Nk0) In Zn k (P), X = f(/3), and the condi- 
tion (fPj) can be easily checked, by employing the exponential bound fll2|) . 

In conclusion, we have proved almost sure convergence for the free energy, 
and convergence of its quenched average, for any subsequence of the form 
{Nqh k }. It is not difficult to show, by standard methods, that this implies 
convergence along any increasing subsequence {Nk}, and the uniqueness of 
the limit. □ 



5 Conclusions 

In this paper, we have extended the class of mean field spin glass models for 
which the existence of the thermodynamic limit can be proved, independently 
of an explicit calculation of the limit itself. Essentially, with respect to the 
models considered in 0, one abandons the assumption that the variance of 
the Hamiltonian is independent of the configuration, and that its mean value 
is additive in the size of the system. Some of the hypotheses of the Theorem, 
like the uniform bounds (|5]), (§), are required only for technical reasons, but 
can be dispensed with, at the expense of some extra work. On the other 
hand, the condition of convexity for the covariance function is essential, so 
that our result does not extend directly, for instance, to the p-spin model, 
with p odd. 
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